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I. Introduction 

Since interference alignment was shown in [1] to achieve the maximum number of degrees of freedom 
(DoF) in K-user (possibly time-varying) interference channels, this technique has attracted considerable 
attention as a candidate for handling interference in multiuser wireless environments. With interference 
alignment, each user achieves almost half of the capacity achievable without interference and the total 
sum rate of the system is given by 

C = y log(SNR) + o(log(SNR)), (1) 

where the o(log(SNR)) term decays faster than log(SNR) as the signal-to-noise ratio (SNR) increases. 
Interference alignment can be classified into two categories: signal level (or scale) alignment [2-8] and 
signal space alignment [1,9-12]. (For a nice survey of the literature in this area, see [13].) While the 
alignment in signal scale lends tractability to DoF characterization, interference alignment in signal space 
provides an attractive way to realize interference alignment in practice. The signal space can be gen- 
erated in several ways, such as by concatenating time symbols or frequency bins as in [1] when the 
channel is varying over time or frequency, or by using multiple-input multiple-output (MIMO) antenna 
techniques. Of these two approaches, MIMO techniques seem to be more robust and attractive for real- 
istic slowly-fading wireless channels [13]. While much work has been done on the feasibility analysis 
and DoF characterization of interference alignment, in this paper we focus on the algorithmic aspect of 
interference alignment in signal space based on MIMO antennas in time-invariant channels. Up to now, 
several algorithms have been proposed to design interference-aligning beamforming matrices at transmit- 
ters and receivers for the practical setting of time-invariant MIMO interference channels [14-18]. While 
these approaches design interference-aligning beamforming matrices, others have proposed algorithms to 
maximize the sum rate directly since interference alignment is optimal at high SNR and optimal only in 
terms of DoF even then, i.e., the o(log(SNR)) term still exists in the sum rate achieved by interference 
alignment. Among these latter types of algorithms, the max-SINR algorithm of Gomadam et al. [14] and 
the sum-rate gradient algorithm of Sung et al. [18] are noticeable and promising. Whereas the latter is 
based on the gradient descent of the sum rate as a cost function, the former is based on the idea of channel 
reciprocity and also on the individual stream approach rather than on the individual user approach aggre- 
gating multiple streams of a single user. Although Gomadam et al. proposed the max-SINR algorithm, 
its overall optimality and behavior were not explored fully in [14]. In this paper, we investigate the re- 
lationship among three beamformer design algorithms: interference alignment, max-SINR and sum-rate 
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gradient algorithms, and show the optimality of the max-SINR algorithm within the class of linear beam- 
forming algorithms at high SNR. Optimizing the beamforming filters for multiuser time-invariant MIMO 
interference channels is not a simple problem as noted in [14], and the analysis of such algorithms as the 
max-SINR algorithm is not a trivial task either due to the nonconvex nature of the problem. Our approach 
to this analytical task is based on fixed point analysis [19]. It is not difficult to show that optimal linear 
beamforming under interference alignment consists of two layers composed of inner and outer layers, 
which was independently derived in [18]. An inner precoder and decoder* accomplish interference align- 
ment to eliminate inter-user interference, and an outer precoder and decoder diagonalize the effective 
single-user channel resulting from the interference alignment by the inner precoder and decoder. Based 
on fixed point analysis, we have shown the following properties of the considered algorithms and the 
relationship among them. 

( i) At high SNR, all fixed points of the max-SINR algorithm with a DoF guarantee are optimal two-layer 
beamformers as noted above. 

( ii) The set of fixed points of the max-SINR algorithm includes the globally optimal linear beamformer 
at high SNR. 

( Hi) Any interference-aligning precoder is a fixed point of the sum-rate gradient algorithm regardless of 
the optimality of the outer precoder and decoder. 

(iv) Finally, at high SNR, the max-SINR algorithm converges exponentially to a fixed point when it is 
initialized within a neighborhood of the fixed point. 

Thus, the max-SINR algorithm is optimal within the class of linear beamforming algorithms at high 
SNR in the sense of (ii). Comparing (i) and (Hi), the max-SINR algorithm has advantage over the sum- 
rate gradient algorithm in that it yields not only interference alignment but also optimal outer coders at 
high SNR. This is because the max-SINR algorithm is based on a stream-by-stream approach and this 
individual stream approach adds resolving power to the max-SINR algorithm compared with the user-by- 
user algorithms. 

This paper is organized as follows. The data model and background are described in Section II. In Sec- 
tion III, we explain the two-layer linear precoder and decoder structure for MIMO interference channels. 
In Section IV, we investigate the properties of the sum-rate based beamformer design algorithms and the 
relationship with the two-layer linear beamforming structure of Section III. In Section V we provide some 
numerical results, followed by conclusions in Section VI. 
*We will use the term 'linear decoder' or simply 'decoder' for the receive filter in this paper. 



November 30, 2010 



DRAFT 



SUBMITTED TO IEEE TRANS. ON INFORMATION THEORY, November 30, 2010 4 
Notation 

We will make use of standard notational conventions. Vectors and matrices are written in boldface 
with matrices in capitals. All vectors are column vectors. For a matrix A, A T and A^ indicate the 
transpose and Hermitian transpose of A, respectively, and rank(A) represents the rank of A. C(A) 
represents the column space of A, i.e., the linear subspace spanned by the columns of A. |A| and A^ 
denote the determinant and Moore-Penrose pseudo-inverse of A, respectively. For a linear subspace S, 
dim(5) denotes the dimension of S, and S 1 - represents the orthogonal complement of S. I„ stands for the 
identity matrix of size n (the subscript is included only when necessary). For a vector a, ||a|| represents 
the 2-norm of a. The notation x ~ A/"(jU, S) means that the random vector x is complex Gaussian with 
mean vector /i. and covariance matrix S. E{x} denotes the expectation of x. A \ 23 denotes the relative 
complement of a set A in another set 23. 

II. Data Model and Background 

We consider a i\~-user M x M MIMO interference channel in which K transmitters each having M 
antennas simultaneously transmit to K receivers each also having M antennas, as shown in Figure 1. 
Due to interference each receiver receives the desired signal from its corresponding transmitter and also 
interference from other undesired transmitters. Thus, the received signal vector at receiver k at symbol 
time t is given by 

y k (t) = H kk (t)\ k (t)s k (t) + J2 U kl(t)Vi(t)si(t) + n k (t), (2) 

l^k 

= K kk (t){v k l \t)s^(t) + ■■■ + v k dk \t) S [ dk) (t)) + YsKklWmsiit) + n*(t), 

l^k 

where H k i(t) is an M x M channel matrix from transmitter / to receiver k at symbol time t, V k (t) = 
[v k (t) , v[ 2) (*),••■ , v^ fe) (t)] is an M x d k transmit beamforming matrix, s k (t) = [s^ (*),■■■ , s^ fe) (t)] T 
is a dfc-dimensional transmit signal vector, d k is the number of data streams for user k, and n k (t) is an 
M x 1 circularly symmetric complex Gaussian noise vector with distribution Af(0, Im). The spatial sig- 
nature vj," 1 ^ (i) of the m-th stream of user k has unit norm. We assume that s["^ (t), m = 1, 2, • • • , d k , are 
independent and E{|s[ m ' > (i)| 2 } = for all t = 1, 2, • • • , and the total transmit power of the overall 
system is given by 

K d k 
fe=l m=l 

We assume that the channels are time-invariant, i.e., the channel matrices {H k i(t)} do not change over 
time. Thus, we omit the time index t from here on. We also assume that channel information is known 
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Fig. 1 

if -USER MIMO INTERFERENCE CHANNEL MODEL. 

to all of the transmitters and the receivers. Further, in this paper we consider the case of d = d\ = cfe = 
• • • = d-x = M/2 to allow for a maximum number of degrees. 

A. Background 

In this subsection, we briefly recapitulate those results of the previous works [14] and [18] that are 
relevant to the analysis in the sequel. 

A. 1 Interference alignment in signal space 

The basic idea of interference alignment via the signal space approach [1] is to confine the interference 
from the undesired transmitters within a linear subspace at the receiver of dimension less than that of the 
received signal space so that the remaining subspace can be used for interference-free communication. 
Thus, the interference alignment condition is given as follows [13, 14]. 

Condition 1: There exist non-zero matrices {Ufc : size(Ufc) = M x d, rank(Ufc) = d, k = 
1, 2, • • • , K} and {V z : size(V ; ) = M x d, rank(V ; ) = d, I = 1, 2, • • • , K } such that 

UfH fc ,V, = 0, keX = {l,2,--- ,K}, le%\{k}, (4) 
and rank(Uf H fcfc V fc ) = d, ke%. (5) 

Here, and = [ujj^ , • • • , ] are the transmit beamforming matrix (or linear precoder) and receive 
beamforming matrix (or linear decoder), respectively, of user k. Thus, when interference alignment is 
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achieved by the transmit and receive beamforming matrices {V^} and {U^}, C(U k ) is the orthogonal 
complement of the aligned interference subspace generated by J2iytk H/yV^s; at user k, and we have the 
following interference covariance matrix and its singular value decomposition (SVD): 

Z fc ± ^H^diag^,...,^^^, 

l^k 

= r fc diag(cT fc i, • • • , a kd , 0, • • • , 0)rf . (6) 

Also, by Hermitian transposing (4) and summing the terms over k, we have J2k^i V/^Hj^ = Vf 1 J2k^i 
(H^U fc ) = 0and 

% ± ^fi tt U fc diag(^,...,^M)Uf& fc> 

k^l 

= t^fcdiagC^fci, • • • , t kd , 0, • • • , 0)f%, (7) 

where H;j. = and P[ m ^ is the power associated with u^ m \ There exist efficient algorithms to obtain 
interference aligning beamforming matrices, e.g., [14-16], and thus interference-aligning beamforming 
matrices {U k , V^} can be acquired easily using such algorithms. 

A.2 Sum rate and the related algorithms 

Although interference alignment achieves the maximum number of degrees of freedom in multiuser 
MIMO interference channels, i.e., the rate achieved by interference alignment is within a constant gap 
from the capacity regardless of the value of SNR at high SNR, larger sum rate can be achieved by linear 
sum-rate maximizing beamforming at low and intermediate SNR and even at high SNR. Consider the 
m-th stream of user k and the corresponding received signal at receiver k given by 

y k = H fcfc vjf } 4 m) + ]T HfcfcV^a^ + ]T H fc ,V,s, + n fcj (8) 
where the covariance matrix of the overall interference and noise for this stream is given by 

K d 
1=1 j=l 

Thus, the signal-to-interference-plus-noise ratio (SINR) maximizing receiver filter ui for this stream is 



given by the whitened matched filter [20] : 
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(the normalization for unit norm does not affect the SINR) and the corresponding rate for the stream is 
given by 

c™ = log (i + p^v^Haoa^)- 1 ^^) . (ii) 

The overall sum rate of the system is given by 

C = EE C t ] - (12) 

fc=l m=l 

Obtaining sum-rate maximizing transmit beam vectors {v™, k = 1, ■ • • , K, m = 1, • • • , d} is not a 
simple problem due to the nonconvex dependence structure of C on vj^ via (R[ m ^) _1 in (11). Thus, 
several researchers have proposed iterative algorithms to design beamforming matrices for maximizing 
the sum rate of the system directly, e.g., [14, 18]. In [14], Gomadam et al. proposed the max-SINR 
algorithm to design sum-rate maximizing linear precoders and decoders based on the individual stream 
approach and on channel reciprocity suggested from the duality between the Gaussian multiple access 
channel (MAC) and the Gaussian broadcast channel (BC) [21-23]. The max-SINR algorithm based on 
the idea of reciprocity provides an effective method to design sum-rate maximizing linear precoders and 
decoders. The optimality and solution structure of this algorithm will be discussed in later sections. 

The max-SINR algorithm (Gomadam et al. [14]) 

Step 1. Fix {Pf^ , k = 1, • • • ,K, m = 1, • • • , d} such that P t = £f =1 Y?m=i ^ and initialize 

n = and {v£ [n]}. (Equal power allocation was used in [14].) 
Step 2. (VU-step) Compute the receiver filters {u k [n]} for all streams of all users from (9) and (10). 
Step 3. (UV-step) Exploiting channel reciprocity, compute {vl [n + 1]} by treating {u[ [n]} from 

Step 1 as the transmit vector and changing the role of transmitter and receiver. That is, obtain the 

interference-plus-noise covariance matrix in the reciprocal channel: 

K d 

K fc L n J - 2^ 2^ l H fc/ U z l n \ u i l n \ ^kl-^k ti kk^ k [n\u k [n\ H kk +L, 

1=1 j=l 

and 



(fe^[n])-ife fcfc uj 



m) 



vL ' [n + 1 = i, , t= r~, . (13) 

||(S^[n])-ifi tt u^[n]|| 

Step 4. Increase n and iterate Steps 2 and 3. 

Note that the max-SINR algorithm itself does not consider interference alignment but tries to increase the 
sum rate through designing better beamforming matrices to increase the stream SINR. 
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On the other hand, Sung et al. proposed a different iterative method to design sum-rate maximizing 
beamforming matrices based on the gradient descent method and user-by-user approach in [18], which 
we call the sum-rate gradient algorithm in this paper. Under the assumption of equal power allocation, 
the rate for user k based on linear beamforming matrices {V^} for the model (2) is given by 



Ck 



log 
log 



I + A(i + Zfc^HfcfcVfcVf Hf fc 

(i + z k y l (i + z k + A Hfcfc v fe vf 

(I + Z*)- 1 (l + ^EH„V,VfHg) 



= log 
= log |Rfe| — log |I + Zfc| , 

where the overall signal covariance matrix for user k is given by 

K 



(14) 
(15) 

(16) 
(17) 



1=1 



H* = £^H„v,v?Hg+i, 



and the overall sum rate is given by 



K 



C = ^C k . 



(18) 



(19) 



k=l 



The direction of maximum increase of the functional C(Vi, • • • , Vr-) is given by the gradient of the 
functional C(Vi , • • • , V^) with respect to V?, where V2 = (Vj^) T , and it is obtained by the complex 
gradient operator [24, 25] : 

V VS C(Vi, ...,V K )=J2( £L Lo ) ■ (20) 



i=i 



dv° k 



From the fact that for a matrix C 

aio g |c({v ; })| 



tr C({V!}) 



5V? 



-i 0C({Vi» 
9V° 



(21) 



the gradient of the sum rate (19) with respect to is given by 

K P P 
VvjC(Vi, ...,V K )=J2 ^H^Rf^ttVfc - lh n ^ 1 + Zir^kVk. (22) 



Kd 



= 1 " l^k 

An algorithm was constructed in [18] to update the beam based on the gradient and to converge at least to 
a local maximum. Note that the max-SINR algorithm is based on the stream-by-stream approach (8, 11, 
12) whereas the sum rate gradient algorithm relies on the user-by-user approach (2, 14, 19). The resulting 
difference between the stream-by-stream and user-by-user approaches will be discussed in later sections. 
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III. Two-Layer Linear Precoder and Decoder Structure 
under Interference Alignment 

In this section, we consider optimal beamforming matrix design under the interference alignment 
constraint, i.e., (4). As already noted in [14], [13] and [18], once interference-aligning beamform- 
ing matrices {U fc } and {V fe } are given, any other matrices that generate the same subspaces as {U fc } 
and {V fc } are also interference-aligning. That is, {V k : V k = \_ k & k , &k £ C dxd ,k G X} and 
{Ufc : Ufc = U fc 0fc, Q k € C dxd ,k G %} are also interference aligning beamforming matrices for 
the given channel for any {& k } an d {©fe} when {U fc } and {V fc } are interference-aligning. Thus, for a 
given interference-aligning subspaces or matrices {U fc } and {V fe }, the matrices and {® k } can be 

optimized further to increase the overall sum rate. 

Problem 1 (Optimization of linear precoder and decoder under interference alignment) For given inter- 
ference aligning subspaces given by the column spaces of {V fc } and {U fc } composed of orthonormal 
columns^, design optimal € C x } and {Q* k £ C x } to maximize the sum rate. Thus, optimal 
interference-aligning linear precoder and decoder are given by 

V£ = V fc * fc and U fc = U fe fe . (23) 

The difference between Problem 1 and the classical MIMO beamforming problem is that in Problem 1 
we have a restriction on the choice of beamforming matrices within the class of interference-aligning 
matrices, whereas the MIMO beamforming problem has no such constraint. However, the solution to 
Problem 1 is simple and here we present its solution for the purpose of later discussion. (It was also 
derived in [18].) Let H k = U fc be the first projection at receiver k. Then, the projected signal at receiver 
k is given by 

r k = Ilfy fe , (24) 
= n^HfefcVfeSfe + nf ^H fc/ V /Si +n fc n fc , (25) 

l^k 

= UkHkk^ k s k + h k . (26) 

The second term on the right-handed side (RHS) of (25) disappears due to interference alignment. Sub- 
stituting Vfc = Y. k ^k into (26), we have 

r k = U k ~H- kk X k & k s k + h k (27) 
^The assumption of orthonormal columns does not result in any loss. 
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where = U^n^ ~ J\f(0, 1) since the columns of U fc form an orthonormal basis. Since U fc , V fc and 
Hfcfc are given, we define adx d equivalent channel matrix = U_ k tlkkY.k for user k (which is known 
to the transmitter and receiver). Let its SVD be 

H fc = U fc A fc Vf . (28) 

Then, the equivalent single user channel for user k under interference alignment and the secondary pro- 
jected signal are given respectively by 

r k = H fc * fe s fe + h k and (29) 
r'k = ©fr fc . (30) 

Now the channel model (29) is simply a conventional single-user MIM O channel with a known channel 
Hfc with indepedent noise n^; optimal <&fc and 0& are given by the right and left singular vectors of Hfc, 
respectively [26]: 

*£ = V fe and0£ = U fe , (31) 
and optimal power allocation is then performed by water-filling across all* Kd independent parallel 
Gaussian channels under the total power constraint P t = J2k=i Em=i Ph™' '• Thus, the best sum rate 
achievable by interference alignment is given by 

R* IA = max ii(V fc *^({V fc ,Uj),U fc 0^({V fc ,U fc })), (32) 

where the dependence of and @£ on ({V fc , U fc }) is explicitly shown and i?(Y fe $£({V fe) U fe }), 
Hfc0fc({Y fc , U fe })) is the best rate achievable by the interference-aligning subspaces spanned by {V fc , U fc }. 

The optimal solution (23) has an interesting precoding and decoding structure, as shown in Fig. 2. That 
is, as noted previously, optimal linear processing under interference alignment is composed of two layers: 
inner precoders and decoders implement interference alignment to yield an other-user-interference-free 
single user channel for each transmit-receive pair, and outer precoders and decoders perform single-user 
optimal channel diagonalization for the single user channel resulting from the inner processing. 

IV. Properties of the Sum-Rate Based Algorithms and their Relationship with the 

Two-Layer Beamformer Structure 

In this section, we investigate the properties and solution structure of the sum-rate-based beamformer 
design algorithms in Section II-A.2, and establish an optimality of the max-SINR algorithm and the 

*Power distribution across all transmitters is a reasonable assumption with transmitter collaboration in current wireless sys- 
tems. 
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11 




inner precoder and decoder t 



outer precoder and decoder 
Fig. 2 

Two-layer linear precoder and decoder structure under interference alignment 



relationship between the sum-rate based algorithms and the two-layer linear beamformer of the previous 
section at high SNR. Under an assumption of sufficiently high SNR, we can use equal power distribution 
P^ = P t /Kd. We begin with an invariance property of the max-SINR algorithm for interference- 
aligning subspace, given in the following theorem. 

Theorem 1: Any interference-aligning subspace is invariant under one composite iteration (composed 
of one VU step and one UV step) of the max-SINR algorithm at sufficiently high SNR. That is, when a 
set of interference-aligning beamforming matrices {Vfc, U^} are input to the iteration of the max-SINR 
algorithm, the resulting matrices after iteration have the same subspace and thus maintains the interference 
alignment property at sufficiently high SNR. 

Proof: Let any interference-aligning beamforming matrices = [vjj^ , vj^ , • • • , v, ] and = 
[uj^ , , • • • , u^] be the input to the max-SINR algorithm at step n (i.e., [n] = and [n— 1] = 
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Ufc for all k). For the m-th stream of user k, the receive filter is obtained by the max-SINR algorithm as 

= (R< m) M)- 1 !^^ [n]/|| (R< m) [n])- 1 ^^ [n] || , 



.("Or 



l^k 



(a) 



\a W a (2) 



Kd 
A (1) +1 



A^+l 





r a {1)H ' 




Mfc, m 




(2)H 








(M)H 







= *[ M y k , m e^/\\ ■ || 



1 

|| ■ ||, as P t — > oo, i.e., for sufficiently high SNR, 
for a scalar r fe , m e J " fc m = q^i^HfcfcV^, 



H fcfe vi m) /|| • ||,(33) 



(34) 



Equality (a) is because {V^} satisfy the interference alignment condition, resulting in rank(^ z _^ fc 
HfczVzV^Hj^) = d = M/2 (see (6)), and the covariance matrix of the additional inter-stream inter- 
ference has rank d — 1. Thus, the total rank is M — 1. Equality (b) is by the assumption of sufficiently 
high SNR. Collecting all m = 1, 2, • • • , d, the VU step of the max-SINR algorithm yields the receive 
beamforming matrix for user k as 



Ufcfnl 



(35) 



With this Ufc [n] as the input to the UV step of the iteration, we obtain a new transmit beamforming matrix 
Vfc[n + 1]. For the m-th stream of user k, 



,(m) 



[n + 1] 



(a) 



(fe^HJ-^fchU^W/IKfi^InD-^kfcU^WII 



(1) (2) 



(*01 
fc ,m \ 



k.m 



o 

J.M-1) 
k.m 



+ i o 



(1) H 

(2) H 
k,m 



(M)H 
k,m 



6 fcfc u< m) [n]/|| <|6) 



w i J m w i'm H ^'* u i M ' [ n l / II ' Hi as P f °°' '■ e '' ^ 0r sufficiently high SNR, 



v k,m ' k,m a 
"k,m K ' 



for scalar r!L m e J<Pk ' 



k : m 



,,( m ) r 
kk u k 1 



(37) 
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where equality (a) is by Lemma 1, i.e., C(Ufc[n]) = C(U k ) (Ufc[n] is also interference-aligning); thus, 
rank(1z = d = M/2 and fej^ [n] has rank M — 1 in total, where 



(38) 



The filters for other streams can be obtained similarly. Combining the filters for all streams of user k, we 
have 

(39) 



V fc [n + 1] = [wj^V^\ w^e 3 '^ 2 , ••• , wfJeW] 



By similar argument as in Lemma 1, we have 

C(\ k [n + 1]) = C([wgp, • • • , wgf ]) = C(K) ± = C(V* 



Thus, we have 



C(V k [n + l])=C(V k )=C(V k [n}). 



(40) 



(41) 



That is, one composite iteration of the max-SINR algorithm preserves an interference-aligning subspace 
at sufficiently high SNR. ■ 

Lemma 1: For the Ufc[n] in (35) obtained by the VU step of the max-SINR iteration, the following 
holds: 

S M ) J M ) J A/ )i 



C(U fc [n]) = CQqg', qg', ■ ■ ■ ,q]Ql) C C(Z fc )" = C(U fc ) 
where Z fc = jfa £ i?4fe H fc ,V,Vf H$. When the rank of U k [n] is d, 



C(U,[n])=C([qg ) ,qg ) , 



, q^ ) ])=C(Z fc ) ± =C(U fc ). 



(42) 



(43) 



Proof: Let the SVD of Z fc be 



(1) (2) JM) 



Odxd Odxd 



(M)H 



(44) 



where ~E k is a d x d diagonal matrix containing non-zero singular values of Zfc. (This is because {Vfc} 
is interference-aligning.) Hence, 



C(Zfc)^ = C([z^ +1) ,... ,zf ) ])=C(Ufc). 



(45) 
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Furthermore, we can see from (33) that 

qS = c([q«,q^--- ) qKr 1) ]) ± *** ^ m 

and for all m 

C(Z k ) C C(R^ W) = C([<L q^, ■ • • , qg^]) (47) 
since Z k is contained in r[ . Now, (46) and (47) imply 

C= C ([<L---.C" 1) ]) ± cC(Z fc ^ (48) 

since C(A) C C(B) => C(B)- 1 C C(A)- 1 . Since qjjjjj € C(Z fc )" L for each m € {1, 2, • ■ ■ , d}, we have 

Caq^^qffr^q^Dc^, (49) 

and (42) follows from (45) and (49). When rank([q^,q^, • • • ,qj^J) = d = rank(Z fe ), two sub- 
spaces are the same, i.e., 

c([q£P,qSV" ) q£ ) D = c(z fe ) ± = c(u fc ). (so) 



Next, we investigate the fixed point structure of the max-SINR algorithm by showing the relationship 
between the (coder) optimal two-layer precoder and decoder structure in Section III and the max-SINR 
algorithm. 

Theorem 2: The two-layer linear beamforming solution (23) with optimal outer coder under interfer- 
ence alignment, i.e., {V* k = V A ,*^({V fc ,U fe }), U£ = U fe 0£({V fc) U fe }), is a fixed point of the max- 
SINR algorithm for any interference-aligning matrices {V fc ,U fc } at sufficiently high SNR. 



Proof: Set {V* k = V fc *£} as the input to the VU step of the max-SINR iteration. Let U k [n] 
[qi 1 e 7 '"*' 1 , • • • > t £kd e ? Wh ' d \ °f (35) be the corresponding output of the VU step (the notation here : 
lows Theorem 1). From (33), qjrj ± C([q$ m , qj?^, • • • , q^ _1) ]) = C{R { k m) ) and this implies 



(M)H I \ - .. » » H H | (JVf) , (AI)H / \- .. .(?) *0')HtiH 1 
<lfc,m (2^ Hfc ' V ' V « H M qfc,m+qfc,m 2-> H ^ V fc V fe H fcfc J qjfc.m- ( 52 ^ 
Mk J \jjtm 
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From Lemma 1 we have 



2 > 



(53) 



Because of this, the first term on the RHS in (52) is nulled out by the interference alignment condition. 
Also, (53) implies that for each m 

(54) 



( M ) _ IT 



for some vector x km . Denote Vt as 



*(i) , *(2) 



(55) 



where is a unitary matrix composed of the right singular vectors of the single-user equivalent channel 
H fc = Uf H fcfc V fc in (28) with SVD H fc = UfcA^Vf = 0^A fc *^ (see (31)). Since both terms of the 
RHS of (52) are nonnegative, we have for the second term 

_ Q Wif fr H^v* (i) v* (i)H H H W M) 



LjymV n kk^ k v fc -"- fcfc q fc 



m ' 



E, 



(M)H 



'(?) 



(6) 



E 



= E J y m |xL(©^ fe *f)0^| 2 , 
W „h / \0')/i*0')\ 

— l^jjLm yL km\ A k °k ) 



\(J)~H a*U) 
A k *km a k 



(56) 



where (a) is by (54) and (55), (b) is by the definition of the equivalent channel, (c) is by its SVD and (d) 
is because $>* k is unitary. Since each term in the summation in (56) is non-negative, each term (i.e., for 
each j) is zero for the sum to be zero. Therefore, the unique x^ m satisfying this is given by 







*(m) 



(57) 



since &* k is unitary, and thus 



J. M ) _ tt a< m ) 



(58) 
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The filters for other streams can be obtained similarly. Combining all the streams yields 

U fc [n] = [qiy^,^^,,,,^)^], (59) 

= [H*0fc ( V Wfc ' 1 , U fe 6>* (2) e^ fe . 2 , ••• , U fc 0* (d) e~], (60) 

= U fc ©£diag(e J ' Wfc ^ e^- 2 ,- • • ,e 7 ' w *- < *), (61) 

= [u^V^S u * (2) e^ fe . 2 , ••• , u* (d) e^ d ]. (62) 



This is valid for all k (i.e., for all users). 

Now consider the UV step of the iteration from Ufc[n] = U£diag(e ja, ' fe > 1 ) • • • , e^ k ' d ) to Vfc[n + 1]. 
From (39) in the proof of Theorem 1, we have 

V fc [n + 1] = [w^e^M, wg'e^M, ... , wgjV'**."] 
and (36) shows that wjg 1 C([w£^, w^, • • • , wj^ _1) ]) = C(^ m) ). From this and (36) we have 

= <2 H (E^U,[n]Uf[n]li + £ ferf[ n ](u«[ n ])^) wg> (63) 
By (40) we have 

C([wSy,wiy,... ,wg ) ])cC(VD=cfe ± , (65) 

where 1z £ = (P t /Kd) Y,i^ k ^ u z* u z* H ^[fci This implies that the first term on the RHS of (64) is zero 
and for each m 

w^J = V fc y fcm 

for some vector yum- By a procedure similar to that used to obtain (57) we obtain the unique y^ m = 
^*(m) jj encC) w (^2 = Y-k&k • Combining all the streams yields, 

V fc [n + 1] = [w^e^M, w^V'^, ••• , wjgV'^], (66) 

= [V fe 0* (1 W, V fe 0* ( V*"=. 2 , • • • , V fe 0* (< V>M], (67) 

= V fc *^diag(e jVfc > 1 ,e J1/,fe - 2 ,--- ,e jVfc ' d ), (68) 

= [v* (1) e^ fc -\ v* ( V^. 2 , ••• , v * (d W>«] (69) 
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for all k. Now, recall from (37) that r' k rn e J¥ ' fc > m = wP^^HjtfeU^fn]. Substituting wj^ = v*S m ^ and 
u i"^[ n ] = ut^e J£Jfe > m into (37) yields 

r' k , m e^ = wgS^u^W = vJ^fettU^V^.-.. (70) 

Also, substituting qi^ in (34) with (58) yields 

= C%vf = u * (m)H H fcfe v* (m) . (71) 

From (70) and (71) we have 

r' k , m ^ k ' m = v; M ^S fcfc u* (m) e^- = rfcjm e-^-e^- = r k , m , (72) 

and thus ip k , m = since both r kiTn and rl are real. This holds for all streams and users, i.e., <p k ,m = 
for all k and m. Finally, from (66) and tp km = 0, we have 

V k [n + l]=V* k = V k [n]. (73) 

Thus, the two-layer linear beamforming solution {V fc ^,U fe 0^} is a fixed point of the max-SINR algo- 
rithm at sufficiently high SNR. ■ 

Note that if the outer precoder and decoder $ and are not optimized to the single user equivalent 
channel resulting from interference alignment by the inner precoder and decoder {V fe , U fc }, then (57) 
and (58) are not valid and thus the beamforming matrices change with the iteration; the interference- 
aligning solution with suboptimal outer coders (including the zero-forcing & k = (H. k $>y) within the 
given space is not a fixed point of the max-SINR algorithm. (Numerical result confirming this will be 
shown in Section V.) Now define the optimal interference-aligning subspaces as the column spaces of 
matrices 

m,Ul} = argmax J R(V fc *^({V fc ,UJ),U fc 0^({V fc ,U fc })), (74) 
Y fe ,U fc 

which achieves R* IA - Then, since Theorem 2 is valid for any interference-aligning matrices, we have the 
following corollary to Theorem 2. 

Corollary 1: {V** = V£$*(V|,U£), U** = U£0*(V£,U£)} is a fixed point of the max-SINR algo- 
rithm at sufficiently high SNR. 

Lemma 2: The globally optimal fixed point of the max-SINR algorithm (in the sense that it has the 
maximum sum rate among all its fixed points) satisfies the interference alignment condition at sufficiently 
high SNR. 

November 30, 2010 DRAFT 



SUBMITTED TO IEEE TRANS. ON INFORMATION THEORY, November 30, 2010 18 

Proof: Suppose that the globally optimal fixed point does not satisfy the interference alignment condition. 
Then, due to the interference leakage the SINR of a certain stream does not increase unboundedly as the 
signal power tends to infinity and the maximum number of degrees of freedom is not achieved with this 
assumed "globally optimal" fixed point. Therefore, this assumed globally optimal fixed point has lower 
sum rate than the interference-aligning fixed point {VI*, U£*} in Corollary 1 at sufficiently high SNR, 
and it is not globally optimal among the fixed points of the max-SINR algorithm. Thus, we have a 
contradiction, and hence the claim follows. ■ 

Theorem 3: {V£*, U£*} in Corollary 1 is the globally optimal fixed point of the max-SINR algorithm 
at sufficiently high SNR. 

Proof: By Lemma 2 the globally optimal fixed point of the max-SINR algorithm is interference-aligning 
at sufficiently high SNR. Among all interference-aligning beamforming matrices, {V£*,U£*} has the 
maximum sum rate R* IA and it is also a fixed point of the max-SINR algorithm by Corollary 1. Hence, 
{V£*, U£*} is the globally optimal fixed-point of the max-SINR algorithm at sufficiently high SNR. ■ 

Theorem 3 established an optimality property for the max-SINR algorithm at high SNR. At high SNR 
one can deduce that the optimal beamformer among all linear beamformers should satisfy the interference 
alignment condition at high SNR by an argument similar to that used in Lemma 2 and thus R* IA in (32) is 
the best sum rate achievable by linear processing at sufficiently high SNR. Thus, the max-SINR algorithm 
is optimal at high SNR among all linear beamformers in the sense that the set of its fixed points includes 
the globally optimal linear beamforming solution { V£* , U£* }. One algorithmic advantage of the max- 
SINR algorithm is that it updates the beamforming matrices at least to be outer-coder optimal. The benefit 
is evident when we consider the sum-rate gradient algorithm based on the user-by-user approach (2, 14, 
19), which has a much larger set of fixed points as described in the following theorem. 

Theorem 4: Any set {Vfc, k = 1, 2, • • ■ , K} of interference-aligning beamforming matrices is a fixed 
point of the sum-rate gradient algorithm in Section II-A.2 at sufficiently high SNR. 

Proof: This result can be proven by computing the gradient (22) at {V^,}. The gradient (22) at {Vfc} is 
given by 

K P P 
Vv S C(Vi,-" ,V*r)|v fc =^^H^R r 1 H /fc V fe -^-^H^(I + Z i )- 1 H ifc V fc . (75) 

i=i i^k 
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The SVD of the term (I + Z/) 1 on the RHS of the above equation is obtained from (44) and is given by 



(i + z,)- 1 



z (l) z (2) . . . JM) 



^l+^-dxd ®dxd 
Odxd Idxd 



(d+l) Ad+2) AM) 
z l z l " ' z 



(d+1) (d+2) AM) 
z l z l ' z 



(M)H 



II 



(76) 



(77) 



t t iii i 

as P t — > oo since the nonzero singular values of Z/ increases without bound as P t — > oo. From Lemma 
1, we have C{[z[ d+1) , ■ ■ • , z[ M) ]) = C(Z / ) ± = C(U Z ). Due to the interference alignment by {V fc , U fc }, 
we have 

(i + z l y 1 H lk v k = o, 

for / k, and thus the second term on the RHS of (75) vanishes 
the first term on the RHS of (75). From the matrix inversion lemma, we have 



(78) 

sufficiently high SNR. Now consider 

om the matrix 



Rf 1 = (l + Zi + ^HuViVfHj) = (m, + Ah V,V, h H^ 

= M r 1 -;| M r 1 H 1 ,v 1 (i + ! 



where = I + Zj. Substituting this i 



P \ _1 

+ ^Vf Hf M^HnVi) Vf HfM;- 1 , 

into the second term yields 



Z=l 

Since M^H/fcVfe = for aWl^k by (78), we have 

p, 



(79) 
(80) 



VvgCCVi,-" ,V*)|^ = ^Hf.M^H^ 



[^H^V^ \f H^M^^fcfcVfc + o(l) 



= as P t -+ oo 
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where (a) holds for sufficiently high SNR since M^ 1 in (77) does not depend on P t . Hence, the gradient 
is zero at {VjJ and {V^} is a fixed point of the sum-rate gradient algorithm at sufficiently high SNR. ■ 

Now the difference between the stream-by-stream approach and the user-by-user approach is clear under 
equal power allocation to all streams. One could have conjectured that aggregating all the streams of a 
user together and formulating the sum rate problem correspondingly to construct an algorithm might yield 
better performance. However, there is an algorithmic disadvantage of such a formulation at least at high 
SNR. For the user-by-user approach (2, 14, 19) to algorithm construction, there is no resolving power 
of the algorithm to distinguish each stream of a user and thus the algorithm yields only a DoF-optimal 
point at high SNR, i.e., it only yields a set of interference-aligning matrices (or user-by-user interference 
alignment), as shown in Theorem 4. On the other hand, the max-SINR algorithm based on the stream-by- 
stream approach has the resolving capability to optimize each stream further and to yield at least a point 
with an optimal outer coder in addition to user-by-user interference alignment. Of course, the sum-rate 
gradient algorithm also contains {V?*, U£*} in its fixed-point set. 

Finally, we examine the convergence behavior of the max-SINR algorithm. The conventional conver- 
gence analysis of the algorithm is not straightforward due to its nonconvex nature and the normalization 
step in each iteration to make each beam vector have norm one. Such a normalization is a projection to 
the surface of a unit sphere in a high dimensional space and it is not a non-expansive^ projection, unlike 
the non-expansive projection to a unit sphere including the inside [27], which makes the application of 
general convergence analysis tools difficult. To circumvent this difficulty, we consider the local conver- 
gence since we have already shown the existence of a fixed point. Based on the perturbation approach, we 
provide the local convergence behavior of the max-SINR algorithm at high SNR, given in the following 
theorem. 

Theorem 5: The max-SINR algorithm converges to a fixed point exponentially when it is initialized 

within a neighborhood around the fixed point at sufficiently high SNR. 

§ A projection II is called non-expansive if | |ITx — IIx| | < |x — y 1 1 for all x and y, which is a useful property for proving 
convergence. 
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Proof: Any point within an e-neighborhood of a fixed point V* is represented as 



21 



V k = (V* k + eP k ) 



a 



(i) 



a 



(2) 



a 



(d) 



(V* k + eP k )A k , 



(82) 



where the matrix P k consists of arbitrary unit-norm vectors. Here {«£ } are the normalization factors so 
that each column of the initial point has unit norm. Since both Y k and P*. have unit-norm column vec- 
tors, we have 1 — e < a, < 1 + e. Thus, we have A k = I — eD^, where = diag^l , 77! , ■ ■ ■ ,?7^) 
and — 1 < rj k m ^ < 1. The interference-plus-noise covariance matrix with the initialization V& is given by 



R 



(m) 



Pi 



Pt 



l^k 



Pt_ 

2— Kd 

l^k 



H W (V? + eP,)(I - eD ; ) 2 (V; + eP,) H H& 



Pt 



+ E jh^ 1 ~ ^) 2H ^K°' } + e p?)K (i) + ^"h* + 1. 



(83) 



After some manipulation, (83) is given by 



R 



{m) =K k m) +eAK k m) + o(e), 



(84) 



where Ri"^ is the interference-plus-noise covariance matrix based on the fixed point V k and 



R (m) _ V— Pi t, Wp^lPV^^lT ^* tt (*{j)(J)H JJ)*(J)H\^t 

AK fc - 2^^ Hfc ^ v ' p « + p « v i ™ + 2^ ^ Hfcfc K Pfc +Pfc v fc 11 



Pt 



(85) 



Note that AR^™' is a full rank matrix unless P/ = V ; * since the third and fourth terms of the RHS of 

(i)H 

(85) already yield rank of M — 1 and v fe pj, adds one to the total rank. (In case of P^ = V ; *, simply 



Ar! is a scaled version of R 



(m) 



I.) Applying the matrix inversion lemma to R-i successively, we 



have 



(Ri m) +eAR«)- 1 + o(e), 



(R^)" 1 " <K k m) y l {(AR^V 1 + e(R^)- 1 } 1 (R-tY 1 + 



e(R 



(■m)s_i. 



X fc (R^ ) )- 1 + o(e), 



(86) 



November 30, 2010 



DRAFT 



SUBMITTED TO IEEE TRANS. ON INFORMATION THEORY, November 30, 2010 22 

where = j(AR.["^)~ 1 + e(R.[ m ' l )~ 1 j . Thus, the unnormalized receive beamforming vector by 
the VU update is given by 

fi M = ( rW)-i % vH = (RM)-i Hfefe (v*^ + eP i m) )(l - e^)- (87) 

Applying (86) to (87), we have after some manipulation 

= (R (-))-i Hfcfc v*W (88) 
-e{4 ro) (Rf Y 1 ^^ + (Rf*))-^^)- 1 ^;^ - (Rir ,) )- 1 H«pi™ ) } + o( e ) > 

where o(e) term starts with e 2 order. From (33) we have 

M-i 

i=l 1 + X k,m 

(i) 

As the SNR increases, X k m — > oo and we have 

for arbitrary <5, where Qfc, m has the trace norm less than one. Substituting (90) into (88) yields 

4 m) = q£2 c i + <*Qfc,mCi - e {qg^ca + 5Q fc , m c 2 } + e 2 + o(e 2 ), (91) 

where ci and c 2 are finite constants and ci and c 2 are vectors with finite norm. Since 5 is arbitrary at 
high SNR, the terms with 5 are negligible. The e-linear perturbation output is aligned with qj^2 which is 
u *( m ) at ^jg^ (s ee Theorem 2.) Thus, the linear perturbation term in e disappears by being aligned 
to the fixed point vector and after this the high order terms starting from the second order in e remain. 
Since the overall normalization is on u[ , it does not change the relative size of each term. Similarly, 
the elimination of the dominant perturbation term holds to the UV step since the UV step is the same as 
the VU step only with the role exchange between and Vfe. Thus, the algorithm converges to the fixed 
point. ■ 

Now the behavior of the max-SINR algorithm is clear at least at high SNR. When it is near a fixed point, 
the algorithm converges exponentially; at every step it converges to the fixed point by eliminating the 
perturbation by aligning to the fixed point by factor e. 

V. Numerical Results 

In this section, we provide some numerical results to validate our analysis in the previous sections. 
We considered the sum rate performance of several beamformer design methods: two layer optimal inner 

November 30, 20 1 DRAFT 



SUBMITTED TO IEEE TRANS. ON INFORMATION THEORY, November 30, 2010 



23 



and outer precoder/decoder design based on interference alignment and channel diagonalization, two- 
layer suboptimal design with interference-aligning inner beamforming and zero-forcing outer filter, i.e., 
@k = (H-k^kV an d = I in (29), and the max-SINR algorithm with orthogonalization. (The or- 
thogonalization step will be explained shortly.) First, we randomly generated a set of MIMO channel 
matrices {H^;}. For this given channel realization, each algorithm was run 500 times with different ran- 
dom initialization (hoping to converge to different fixed points). Here, we used the iterative interference 
alignment (IIA) algorithm in [14] to obtain the interference-aligning subspaces. 
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Fig. 3 

Sum rate as a function of SNR with 500 random initializations: (a) interference alignment 

WITH OPTIMAL POWER ALLOCATION, (B) MAX-SINR ALGORITHM, (C) (A) AND (B) IN A SINGLE FIGURE, 

(D) SUM RATE AVERAGED OVER INITIALIZATIONS 
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TABLE I 

Sum rate and percentage of fixed points as functions of SNR when M = 2 and d = l: the 



NUMBERS WITHOUT AND WITH PARENTHESIS IN EACH BOX CORRESPOND TO SUM RATE AND PERCENTAGE 
OF THAT FIXED POINT OVER 500 RANDOM INITIALIZATIONS, RESPECTIVELY. 



Fig. 3 shows the sum rate performance in case of K = 3 and M = 2d = 2. In this case, there is no 
outer coder issue since d = 1, but we can optimize power allocation under interference alignment. Fig. 
3 (a) shows the sum rate curve as a function of SNR for all initializations for interference alignment with 
optimal power allocation. (The 500 curves overlap on the two distinct curves. Here, we generated one ini- 
tialization randomly, and the IIA algorithm was run for different SNR values with the same initialization. 
This procedure was repeated over 500 times.) From [1] we know the number of interference-aligning 
subspaces is ^ M \ for M x M MIMO channels when interference alignment is feasible. Indeed, we 
see in the figure that there exist only two modes or fixed points in 2 x 2 MIMO with d = 1. Since the 
IIA algorithm does not depend on the SNR, if one initialization ends with either of the two fixed points, 
that initialization ends with the same fixed point regardless of the value of SNR, i.e., we see two parallel 
lines in the figure. On the other hand, Fig. 3 (b) shows the sum rate curve as a function of SNR for all 
initializations for the max-SINR algorithm. (The procedure was the same as that of Fig. 3 (a).) Since 
the algorithm depends on the SNR, now the surface of the sum rate functional changes with SNR and the 
same initialization can lead to a different fixed point as SNR changes. That is, there are the cross-over 
lines in Fig. 3 (b). It was also observed that the cross over is unidirectional in most cases, i.e., we only 
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have either an Fl to F2 or an F2 to Fl transition once in most cases as SNR increases. We seldom 
have such a transition as Fl — > F2 — > Fl, which implies that the sum-rate surface is not too irregular. 
Fig. 3 (c) is the figure combining Fig. 3 (a) and (b) together. It is seen in the figure that for each mode 
(or fixed point) the max-SINR algorithm and interference alignment coincide at high SNR, as predicted 
by Theorem 2. Table V shows more detailed information in this case. At low SNR, there is some gain 
to be had by optimal power allocation for the same interference alignment, but the gain is negligible and 
the two coincide as SNR increases since equal power allocation is optimal at high SNR. As expected, 
the max-SINR algorithm has further gain over interference alignment with optimal power allocation at 
low SNR (e.g. dB) for each mode. At high SNR, all three coincide for each mode as predicted. One 
interesting observation is that the interference alignment and the max-SINR algorithm have almost the 
same sum rate in each mode from 10 dB SNR and the difference in the average sum rate in Fig. 3 (d) 
comes from the fact that the max-SINR algorithm is more likely to end with the better fixed point (i.e., the 
globally optimal one, Fl, in this case) with arbitrary initialization than is interference alignment across 
all the SNR values. 

In case of M = 4 and d = 2, on the other hand, the situation is more complicated. Table V shows 
the sum rate performance in this case. The same procedure was performed as in the single stream case. 
We observed ( 4 | = 6 fixed points^ at each SNR, denoted as Fl to F6 in the table. Now the role of the 

V 2 J 

outer precoder and decoder is clearly seen. Comparing the optimal two-layer and suboptimal two-layer 

designs based on interference alignment, we see that there is noticeable degradation in the suboptimal 

outer coder case with the same interference-aligning subspace, i.e., the same mode. The gap does not 

vanish as SNR increases. Also, the table shows that the max-SINR algorithm indeed coincides with the 

two-layer optimal beamforming of Section III for each of the six modes at high SNR, predicted by our 

Theorem 2; all the fixed points of the max-SINR algorithm are two-layer optimal points at high SNR. 

The Fl 's of the two algorithms are the same globally optimal linear beamforming point, i.e., {VJ* , U£* } 

in Theorem 3. Consistently with the case of d = 1, it is seen that the max-SINR algorithm is more likely 

to converge to a better fixed point. (See the distribution of fixed points.) Another interesting fact is that at 

1 In the two-layer suboptimal case, each point in the same interference-aligning subspace may yield a different sum rate and 
the number of observed sum rates might not have been six. However, if we confine to beamforming matrices with columns' 
being an orthonormal basis for the subspace, then the sum rate is the same for the subspace regardless of the choice of the 
orthonormal basis. That is, C k = log |I + U H H fcfe VV ff Hf fe U| = log |I + U^HfefcVV^H^UI if U and U are two 
different orthogonal bases for the same subspace and so are V and V. This is the case with the IIA algorithm which returns 
beamforming matrices with orthonormal columns, and thus we observe six sum rate values in this case also. 
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Algorithm 




OdB 


J (Vjjj 


20dB 


30dB 


40dB 


50dB 


6()dB 


70dB 


80dB 


max-SINR with 
orthogonalization 


Fl 


8.91 
(100) 


20.88 
(15.4) 


36.41 
(16.0) 


54.75 
(35.6) 


74.53 
(29.2) 


94.45 
(28.0) 


114.38 
(28.0) 


134.31 

(28.0) 


154.24 
(28.0) 


F2 


(0) 


20.82 
(43.4) 


35.90 
(41.6) 


54.45 
(13.4) 


74.12 
(13.0) 


94.03 
(13.0) 


113.95 
(13.0) 


133.89 
(13.0) 


153.82 
(13.0) 


F3 


(0) 


20.55 
(6.6) 


35.88 
(35.6) 


53.58 
(27.8) 


73.18 
(0.8) 


93.10 
(0.8) 


113.03 
(0.8) 


132.97 
(0.8) 


152.90 
(0.8) 


F4 


(0) 


20.42 
(27.4) 


34.24 
(0.6) 


52.34 
(0.8) 


72.14 

(33.0) 


91.68 
(34.4) 


1 1 1 .55 

(34.2) 


131.48 
(34.4) 


151.41 
(34.4) 


F5 


(0) 


20 41 
(7.2) 


3d, 91 

(6.2) 


52 132 
(11.4) 


71 62 
(12.4) 


01 SO 

(12.4) 


1 1 1 4 1 
(12.4) 


111 IS 
1 J 1 .JJ 

(12.4) 


1 S 1 9Q 

1 j 1 . Z y 

(12.4) 


F6 


(0) 


(0) 


(0) 


S9 i in 

JZ. 1 JU 

(11.0) 


71 A 1 

(11.6) 


Ql 9ft 
7 1 .ZO 

(11.4) 


111 IS 
111.10 

(11.6) 


111 11 
1 J 1 . 1 1 

(11.4) 


1 S 1 OA 
1 J 1 . \}-\ 

(11.4) 


Average rate 


o.y i 


ZU.O / 


IS Sft 


SI 7Q 

jj. ly 


79 Oft 


Q9 70 

yz. /v 


1 19 ft 1 
1 1Z.D1 


1 19 SA 


1 S9 Al 
1 JZ.t / 


Two-layer optimal 


Fl 


7.21 
(33.2) 


19.18 

(33.2) 


35.08 
(33.2) 


54.63 
(13.8) 


74.52 
(13.8) 


94.45 
(13.8) 


114.38 
(13.8) 


134.31 
(13.8) 


154.24 
(13.8) 


F2 


7.16 
(12.0) 


18.14 
(13.8) 


35.08 
(13.8) 


54.19 
(9.8) 


74.09 
(9.8) 


94.02 
(9.8) 


113.95 
(9.8) 


133.89 
(9.8) 


153.82 
(9.8) 


F3 


6.93 
(26.0) 


17.95 
(12.0) 


34.56 
(9.8) 


53.27 
(5.2) 


73.17 
(5.2) 


93.10 
(5.2) 


113.03 
(5.2) 


132.97 
(5.2) 


152.90 
(5.2) 


F4 


6.82 
(13.8) 


17.76 
(26.0) 


33.63 
(5.2) 


52.27 
(33.2) 


71.74 

(33.2) 


91.62 
(33.2) 


111.55 

(33.2) 


131.48 
(33.2) 


151.41 

(33.2) 


F5 


ft ss 

D.Jo 

(9.8) 


17 18 
1 / .IB 

(9.8) 


19 ft7 
jZ.O/ 

(12.0) 


S 1 71 

(12.0) 


71 S7 

(12.0) 


Ql AQ 
y L.t+y 

(12.0) 


1 1 1 A9 

(12.0) 


111 IS 

1 J l.JJ 

(12.0) 


1 S 1 9Q 

1 j 1 .Ly 

(12.0) 


F6 


s sn 

(5.2) 


i ft i s 

(5.2) 


19 S9 

(26.0) 


s i sn 

j l.JU 

(26.0) 


71 11 

(26.0) 


Q1 9S 
y 1 .ZJ 

(26.0) 


111 IS 
111.10 

(26.0) 


111 11 

1j1.11 

(26.0) 


1 S 1 OA 

(26.0) 


Average rate 


ft Ql 


1Q 17 
10.1/ 


ia 


S9 S7 


79 in 


Q9 91 
yz.z 1 


11"' 1 A 
1 1 Z. 1*+ 


1 19 07 
1 jZ.U / 


1 S9 OO 
IjZ.UU 


Two-layer suboptimal 


Fl 


4.21 
(5.2) 


15.55 
(5.2) 


33.31 
(5.2) 


52.96 
(5.2) 


72.86 
(5.2) 


92.79 
(5.2) 


112.72 
(5.2) 


132.65 
(5.2) 


152.58 

(5.2) 


F2 


4.05 
(13.8) 


14.58 
(13.8) 


31.80 
(13.8) 


51.36 
(13.8) 


71.25 
(13.8) 


91.18 
(13.8) 


111.11 

(13.8) 


131.04 
(13.8) 


150.97 
(13.8) 


F3 


3.56 
(33.2) 


12.94 
(33.2) 


29.34 
(9.8) 


48.97 
(9.8) 


68.87 
(9.8) 


88.80 
(9.8) 


108.73 
(9.8) 


128.66 
(9.8) 


148.59 
(9.8) 


F4 


2.82 
(12.0) 


11.88 
(9.8) 


26.96 
(33.2) 


44.52 
(33.2) 


64.02 

(33.2) 


83.90 
(33.2) 


103.83 
(33.2) 


123.76 
(33.2) 


143.69 
(33.2) 


F5 


2.65 
(26.0) 


10.18 
(12.0) 


25.04 
(12.0) 


44.13 
(12.0) 


63.97 
(12.0) 


83.89 
(12.0) 


103.82 
(12.0) 


123.75 
(12.0) 


143.68 
(12.0) 


F6 


2.36 
(9.8) 


10.14 

(26.0) 


24.94 
(26.0) 


43.96 
(26.0) 


63.79 
(26.0) 


83.71 
(26.0) 


106.64 
(26.0) 


123.58 
(26.0) 


143.51 
(26.0) 


Average rate 


3.22 


12.14 


27.44 


46.15 


65.89 


85.80 


105.73 


125.66 


145.59 



TABLE II 



Sum rate and percentage of fixed points as functions of SNR when M = 4 and d = 2 
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dB SNR the max-SINR algorithm shows only one mode. This can easily be explained. The term 
on the RHS of (11) converges to I at very low SNR and (7^ becomes quadratic in vj." 1 ^ and thus has a 
unique solution; the optimal vjjT^ with maximum SINR at low SNR is simply the eigenvector of Hj^Hfcfc 
associated with the largest eigenvalue. This low SNR behavior is seen at dB SNR. Fig. 4 shows the sum 
rate performance averaged over all random initializations in this case. The average behavior is almost the 
same as that of each mode; the two-layer optimal beamforming under interference alignment matches the 
max-SINR algorithm at high SNR. One noticeable thing is that the original max-SINR algorithm in [14] 
can yield linearly dependent beam vectors and does not guarantee the DoF, as shown in the black curve 
in Fig. 4. (It is easy to show that linearly dependent beams can be a fixed point of the original max-SINR 
algorithm at high SNR by setting [n] = e^vi [n] and deriving v£ [n + 1] and vl 2 ^ [n + 1] as in 
Theorem 2.) However, this problem was fixed easily by inserting orthogonalization after each step. This 
insertion does not cause any loss at high SNR since outer-coder optimal fixed points with DoF guarantee 
themselves have orthonormal columns. Also, the simulation shows that at low and intermediate SNR (0 
to 20 dB SNR) the algorithm yields the same performance with or without orthogonalization. 




Fig. 4 

Average sum rate when K = 3, M = 4 and d = 2 
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Finally, Fig. 5 show the sum rate performance of the algorithms with one initialization averaged over 
100 different random channel realizations from a Gaussian distribution. Similar behavior is seen among 
the three algorithms. The performance gap of the zero-forcing outer filter and optimal outer filter under 
interference alignment can be obtained similarly to the classical point-to-point MIM O case [28] as 



AC = K {^y^xl} - (d~ l)E{log X |}j , 



(92) 



for the Gaussian channel, where x%i denotes the chi-squared distribution with 2i degrees of freedom. For 
the example of d = 2, AC « 4.328 bits, which matches the simulation well. 




40 
SNR (dB) 




40 
SNR (dB) 



(a) 



(b) 



Fig. 5 

Sum rate performance averaged over 100 RANDOM channel realizations (a) M = 2d = 2 AND 

(B) M = 2d = 4 



VI. Conclusion 

In this paper we have considered several beamformer design algorithms for time-invariant MIMO inter- 
ference channels including interference alignment and sum-rate based algorithms such as the max-SINR 
and sum-rate gradient algorithms. We have established the relationship between the sum-rate based algo- 
rithms and optimal linear beamforming under interference alignment given by the two-layer beamforming 
structure consisting of inter-user interference-aligning inner filters and single-user optimal outer filters. 
We have shown the optimality of the max-SINR algorithm at high SNR and the algorithmic advantage 
of the stream-by-stream approach, and have also established the structure of the fixed point set and local 
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convergence of the max-SINR algorithm at high SNR and the single mode behavior of the algorithm at 
low SNR. The optimality here is in the sense that the algorithm contains the globally optimal beamformer 
in the fixed point set, and thus driving the algorithm to the globally optimal fixed point with arbitrary 
initialization is still an open issue. 
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